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Description 
FIELD OF THE INVENTION 

[0001] The present invention relates generally to im- 
age capture devices that have a photo sensor or sen- 
sors that have dual resolutions. The photo sensor or 
sensor array has a set of high -resolution photo elements 
and a set of lower resolution photo elements. Substitut- 
ing the low resolution signal for the high resolution signal 
in areas of the image that have low signal strength and 
low spatial frequency can improve the signal to noise 
ratio of the image. 

BACKGROUND OF THE INVENTION 

[0002] Digital scanners typically create an image by 
focusing an area of a page onto a photo sensor. The 
photo sensor is typically a charged-coupled device 
(CCD). The CCD is typically composed of a row of pho- 
tosensitive elements. The row of elements is typically 
imaged across the width of the scanner bed. The width 
across the bed of a scanner is typically called the x-di- 
rection and the length along the long axis of a scanner 
bed is typically called the y-direction. To create an image 
of the page, the row of photo sensors is typically moved 
along the y-direction, taking exposures corresponding 
to each row along the x-direction. The optical resolution 
of the scanner in the x-direction is equal to the number 
of photosensitive elements in the CCD divided by the 
width of the page. The resolution of a scanner in the y- 
direction is a function of the movement rate of the CCD 
along the y-direction and the exposure rate of the CCD. 
[0003] Today one of the main purchasing criteria is the 
optical resolution of a scanner. This tends to drive scan- 
ner manufactures to increase the optical resolution of 
scanners. For a given CCD die size, as the optical res- 
olution in the x-direction increases, the size of the photo 
sensor elements decreases. The CCD die size is con- 
tained to keep the price of the CCD reasonable. Typi- 
cally the CCD has three rows of photosensitive ele- 
ments, one each for detecting red, green, and blue light. 
The spacing between the three rows of photosensitive 
elements is one factor in determining the amount of 
memory needed in the scanner. The larger the line spac- 
ing between rows, the more memory needed. Unfortu- 
nately the shift registers also need to be in-between the 
rows of photosensitive elements. The spacing between 
the rows, and the number of elements in each row, limit 
the size of each shift register. The smaller the size of 
the shift register, the lower the signal carrying capacity 
of those shift registers, which results in a lower possible 
the signal-to-noise ratio. Figure 1 shows a plot of the 
signal-to-noise ratio vs. absolute signal level for a lower 
resolution CCD and a higher resolution CCD which have 
the same die size and line spacing. The increase in 
noise is a bigger problem in the dark areas of an image. 
This is true for two reasons. First when the image signal 



is low the noise sources are large by comparison, which 
negatively impacts the signal-to-noise ratio in the dark 
areas of the image. Second the human visual system is 
more sensitive to noise in dark areas of an image. 

5 [0004] One of the solutions to this problem is a CCD 
that contains two different resolutions. The CCD has a 
row of high-resolution photo sensors and a row of lower 
resolution photo sensors. The high-resolution row of 
photo sensors is typically two times the resolution of the 

10 lower resolution photosensors. Color scanners typically 
have three rows of photo sensors, one row for each color 
(red, green and blue). The dual resolution color CCD 
has three rows of photo sensors for each resolution for 
a total of six rows of photo sensor elements (see figure 

*5 2). The scanner uses the high resolution CCD for high- 
resolution scans and the low resolution CCD for low res- 
olution scans. Unfortunately this only solves the noise 
problem for the lower resolution scans when the scan- 
ner is using the low-resolution, higher signal-to-noise 

20 photo sensors. Therefore there is a need for a system 
that can combine the improved signal-to-noise charac- 
teristics of the low-resolution sensor signal, with the 
high-resolution signal, without losing the high spatial fre- 
quency information from the high-resolution signal. 

25 

SUMMARY OF THE INVENTION 

[0005] A method of combining the low resolution, 
higher signal-to-noise information with the high resolu- 
30 tion, low signal-to-noise information created by a dual 
resolution CCD. 

[0006] Other aspects and advantages of the present 
invention will become apparent from the following de- 
tailed description, taken in conjunction with the accom- 
35 panying drawings, illustrating by way of example the 
principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 [0007] 

Figure 1 is a chart of the signal-to-noise ratio vs. 
absolute signal of a 600 ppi CCD and a 1200 ppi 
CCD. 

45 Figure 2 is a drawing of a dual resolution CCD. 

Figure 3 is a flow chart of the method of combining 
the low resolution, higher signal-to-noise informa- 
tion with the high resolution, low signal-to-noise in- 
formation created by a dual resolution CCD in ac- 
50 cordance with the present invention. 

Figure 4 is a drawing of a section of high resolution 
photo sensitive elements and their corresponding 
low resolution photo sensitive elements of a dual 
resolution CCD with a high spatial frequency line 
55 imaged on the CCD elements. 

Figure 5 is a chart of the signal strengths of the pix- 
els from figure 4. 
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DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 



[0008] A system that can combine the low noise infor- 
mation with the high-resolution information without los- 
ing the higher spatial information from the high resolu- 
tion CCD can improve an image created with a dual res- 
olution CCD. 

[0009] CCD's have a number of different noise sourc- 
es. Some of the noise sources are independent of the 
signal level collected by the photosensitive element. 
Other noise sources are dependent on the absolute sig- 
nal level of the charge collected by the photosensitive 
element. Lower resolution CCDs have better signal-to- 
noise performance than higher resolution CCDs given 
the same die size, line spacing and the same amount of 
light falling on the photosensitive elements. Once the 
signal-tonoise ratio gets above a threshold, typically 30: 
1 , the human eye can no longer see any difference. 
Therefore when the signal strength coming from the 
CCD corresponds to a signal-to-noise ratio less than 30: 
1 the signal coming from the lower resolution CCD Is the 
best signal to select. Therefore the first step in the meth- 
od of combining the information from the dual resolution 
CCD is comparing the absolute signal level of the high 
resolution CCD with a threshold value (see figure 3). 
[0010] In one embodiment the threshold value is typ- 
ically set at approximately 40% of the full charge level 
of the high resolution CCD. 40% is used as the threshold 
because both the high-resolution photo-sensors and the 
lower resolution photo sensors are still within their linear 
range. If the absolute signal level of a photo sensitive 
element in the high resolution CCD is greater than the 
threshold value then the signal is left undisturbed and 
the next photo sensitive element is checked (304). 
When the signal level of the high-resolution photosen- 
sitive element is below the threshold value the signal is 
examined to determine if the signal contains high fre- 
quency spatial information. 

[0011] The method used to determine if a high reso- 
lution pixel contains high frequency spatial information 
is to compare the difference in the signal strength of the 
high resolution pixel and the corresponding low resolu- 
tion pixel with the noise level in the high resolution pixel 
or N(HJ < ABS\H S - L«J. N(H S ) is the noise at the current 
high-resolution signal strength. H s is the current high- 
resolution signal strength and L. is the current low-res- 
olution signal strength. When the difference in the signal 
strength between the high and low resolution pixels is 
greater than the amount of noise possible in the high 
resolution pixel, then the difference must be due to a 
feature in the image and not due to noise. Figure 4 
shows a section of a high resolution CCD and the cor- 
responding section of the low resolution CCD with a high 
frequency spatial line imaged onto the CCD segments. 
Photosensitive elements or pixels 402 and 404 from the 
high resolution CCD and pixel 41 8 from the low resolu- 
tion CCD contain line 422. Pixels 406 through 41 6 of the 



high resolution CCD and pixel 420 of the low resolution 
CCD do not contain line 422. Figure 5 shows the signal 
strength of the pixels from figure 4. The signal strength 
of pixels 402 and 404 are much lower than signal 
5 strength of pixels 406 through 41 6 due to line 422. The 
signal strength of pixels 406 and 408 are not equal to 
each other due to noise. Applying the method of equa- 
tion 1 to pixel 402 would result in keeping the signal in 
pixel 402 undisturbed. The signal strength H s in pixel 
w 402 is 20. The noise level N(h s ) at signal strength 20 is 
4. The signal strength L, of the corresponding low-res- 
olution pixel 418 is 60. Which results in 4 < ABSI20 - 
60I. Applying the method of equation 1 to pixel 416 
would result is a substitution of the signal from pixel 420 
15 into pixel 416. The signal strength H s in pixel 416 is 99. 
The noise level N(h s ) at signal strength 99 is 2. The sig- 
nal strength of the corresponding low-resolution pixel 
420 is 1 00. Which results in 2 < ABSI99 - 1 00I. The noise 
levels and signal strengths used in the above examples 
20 are for illustration purposes to help explain the operation 
of the current invention. The actual noise levels used in 
this invention would be the noise levels that correspond- 
ed to the signal strength of the photosensitive elements. 
[001 2] The foregoing description of the present inven- 
ts tion has been presented for purposes of illustration and 
description. It is not intended to be exhaustive or to limit 
the invention to the precise form disclosed, and other 
modifications and variations may be possible in light of 
the above teachings. For example, the first step of com- 
30 paring the absolute signal strength of a pixel to a thresh- 
old value saves time by avoiding computation in cases 
when substitution is unlikely, but this step can be elimi- 
nated. The embodiment was chosen and described in 
order to best explain the principles of the invention and 
35 its practical application to thereby enable others skilled 
in the art to best utilize the invention in various embod- 
iments and various modifications as are suited to the 
particular use contemplated. It is intended that the ap- 
pended claims be construed to include other alternative 
40 embodiments of the invention except insofar as limited 
by the prior art. 
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Claims 

1. A method of combining low-resolution information 
with high-resolution information created by a dual 
resolution photo-sensor array, comprising: 

determining a high-resolution signal for a high- 
resolution pixel; 

determining a noise level (308) forthe high-res- 
olution pixel; 

determining a low-resolution signal for a corre- 
sponding low-resolution pixel; 
replacing the high-resolution signal (310) with 
the low-resolution signal as a function of the 
high-resolution signal, the low resolution sig- 
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nal, and the noise level of the high-resolution 
pixel. 

2. The method of claim 1 further comprising: 

computing a magnitude of a difference (306) 5 
between the high-resolution signal and the signal of 
the corresponding low-resolution pixel. 

3. The method of claim 2 further comprising: 

replacing the high-resolution signal with the 
low-resolution signal when the noise level is less 
than the magnitude of the difference between the 
high-resolution signal and the corresponding low- 
resolution signal. 

4. The method of claim 1 further comprising: 

comparing the high-resolution signal with a 
threshold value (302); 

retaining the high-resolution signal when the 20 
high-resolution signal is greater than the 
threshold value (304). 

5. The method of claim 1 where the photo sensor array 
is a CCD. 25 
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